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Sample-to-sample free energy fluctuations in spin-glasses display a markedly different behaviour 
in finite-dimensional and fully-connected models, namely Gaussian vs. non-Gaussian. Spin-glass 
models denned on various types of random graphs are in an intermediate situation between these 
two classes of models and we investigate whether the nature of their free-energy fluctuations is 
■ Gaussian or not. It has been argued that Gaussian behaviour is present whenever the interactions 

are locally non-homogeneous, i.e. in most cases with the notable exception of models with fixed 
connectivity and random couplings Jy = ± J. We confirm these expectation by means of various 
analytical results. In particular we unveil the connection between the spatial fluctuations of the 
populations of populations of fields defined at different sites of the lattice and the Gaussian nature 
of the free-energy fluctuations. On the contrary on locally homogeneous lattices the populations 
do not fluctuate over the sites and as a consequence the small-deviations of the free energy are 
non-Gaussian and scales as in the Sherrington-Kirkpatrick model. 
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I. INTRODUCTION 

The problem of sample-to-sample free energy fluctuations in spin-glasses has attracted larg e interest in recent years 
both from the theoretical and numerical point of view 0, @, 1, 11 Hi, 0, 1 H 03, HO, 03, M, Q d • 

In general at fixed system size N the free energy per spin of a given sample is a random variable with mean /jy 
and variance a%. In the thermodynamic limit /jv approaches a definite value ft yp while ct/v approaches zero: the 
free energy is self-averaging and does not depend on the sample. It is expected that in the thermodynamic limit, 
the rescaled variable x = (/ — Jn)/o'n has a limiting probability distribution that describes the small deviations of 
the free energy, i.e. those that occur with finite probability and whose scale decreases with N. On the other hand 
large deviations of the free energy, i.e. those that remains finite in the large N limit have a probability that vanishes 
exponentially with the size of the system and are described by a large deviation function [lj, [TJ, [l5|, [lj| • 

In finite-dimensional models one expects the small deviations of the free e nerg y to have a Gaussian distribution 
with variance proportional to the volume of the system i.e. er/v oc mean-field models however the 

standard arguments leading to this expectation no longer hold and more exotic situations can be observed. Indeed the 
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scalingof ajv with N in the Sherrington-Kirkpatrick(SK) model [18( has been largely studied numerically in recent 
years [J d, y, 0, [H, 0, [1(3] and there is growing consensus that o/v oc N~ 5 ^ 6 . This scaling had been conjectured early 
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', m UM using a large deviations result by Kondor [19( under the assumption that there is a matching between large 
I/"") ■ and small deviations (for a recent discussion see [lj])- The large deviation result of Kondor had been questioned in 
0, @] but was later proved to be correct (20| . The distribution of negative large deviations was computed down to zero 
temperature and excellent agreement with numerical results was found (l3l Il4j . Currently there is no analytical tool 
7—1 ' to compute directly <7jv nevertheless the recent computation of positive large deviations [15[ adds further support to 
0^ . the 5/6 scaling. Furthermore the evaluation of the small-deviation distribution of the SK model is an open problem. 
We just know that it is not a Gaussian function but it has been argued that the behaviour of its tails can be deduced 
| from the large deviations behaviour [15] . 

Mean-field spin-glass models defined on random graphs are considered as something intermediate between fully- 
connected models (notably the SK model) and finite-dimensional models. Indeed they have a mean-field nature 
but are more realistic because every spin interacts with a finite number of neighbours. Therefore it is natural to 
ask what is the behaviour of the free energy fluctuations in these models. In particular we can ask if the small 
deviation distribution is Gaussian and if the large deviation function is similar to the one found in the SK model. 
The ground state properties of spin-glass models defined on the Bethe Lattice have been studied intensively in recent 
times @, [111, [2l|, [52, [HI . Our investigation was motivated by the findings of Ref . [|J ■ The authors of Ref . [H observed 
that both the scaling of cat and the shape of probability distribution of the ground state energy of a spin-glass defined 
on random graphs with fixed connectivity depends on the distribution of the couplings. In particular on a random 
graph with fixed connectivity and Gaussian distributed couplings Jy it turned out that <t/v oc N^ 1 / 2 (as in finite 
dimensional models) and that the skewness of the small-deviation distribution tends to zero at large N, consistently 
with the assumption that it is a Gaussian. However in the case of fixed connectivity and bimodal distribution of the 
couplings (Jij = ±J) they observed a scaling of ctn definitively different from iV -1 / 2 , (possible values being iV -3 / 4 
or ./V -4 / 5 ) . Furthermore it turned out that the skewness of the small deviation distribution instead of vanishing at 
large N tends to go to a finite value consistent with that of the SK model. 
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In this paper we compute the large deviations of the models considered by [jf, i.e. spin-glass models defined on 
graphs with fixed connectivity. We consider the following functional [H, 0, EH : 



$N(n,0)=-—]nZj(0) n , (1) 

where different systems (or samples) are labeled by J, Zj{j3) is the partition function of a given sample and the 
bar denotes the average over different disordered samples. The above functional is the generating function of the 
cumulants of the sample-to-sample fluctuations of the free-energy. In order to determine the moments of the small 
deviation distribution we should first compute the derivatives with respect to n of <&w(n) at n — 0, and then take 
the limit N — > oo. This apparently simple step is a complex and open problem also in the SK model EH, [T3. 
instead the opposite case in which one takes first the N — > oo limit and then the n — > limit is tractable, see [14[ for 
a complete discussion of this issue. This amounts to compute: 

<f>(n,/3) = lira $jv {n,j3) (2) 

N— >oo 

It is well known that the probability of large deviations is related to the function $(n,/3). Indeed 



exp(-/3n7V$(n, /?)) = Zj(j3) n = exp(-nNf3fj(/3)) , (3) 

where fj is the system-dependent free energy per spin. The region of positive n corresponds to fluctuations where 
the free energy is smaller than the typical one and the region on negative n corresponds to fluctuations where the free 
energy is larger than the typical one. 

We define the large deviation function for the free energy, L(f), (that we will call in the following the sample 
complexity because it is related to the number of samples with free energy equal to /) as the logarithm divided by N 
of the probability density of samples with free energy per spin / in the thermodynamic limit: 

IWJtaJS^tffl. (4) 

For large N the majority of the samples has free energy per spin equal to ft yp , and all other values have exponentially 
small probability. Consistently L(f) is less or equal than zero, the equality holding / = f typ , i.e. L(f typ ) = 0. For 
some values of / it is possible that L(f) — — oo, meaning that the probability of large deviations goes to zero faster 
than exponentially with N. In the thermodynamic limit the function $(n,/3) defined in eq. |T]) yields the Legendre 
transform of L(f) [16j, indeed we have: 

- /3n$(n) = -/3nf + L(f) (5) 

where / is determined by the condition: 

r)T 

0n = gj (6) 

and equivalently we have: 

Hf) = M - I3n<£(n) (7) 

where f3n is determined by the condition: 

(8) 

on 

Note that while numerical methods are best suited to study small deviations (precisely because they are typical) 
present day theoretical methods deal mainly with large deviations. This is because at the theoretical level large 
deviations requires essentially treating a replica field theory at the mean-field level, while small deviations requires the 
computation of the loop corrections. Furthermore the problem is made even more complicated by the fact that these 
corrections are singula r [l5|. N evertheless it is usually assumed that information on small deviations can be extracted 
from large deviations [l4L 16j|. In particular if the expansion of n$(n) around n — reads n$(n) = nft yp + C2n 2 
one expects that rj (— 2c2//3) 1,/2 A r ~ 1 / 2 and that the small deviation function is a Gaussian. In the SK model 
instead n$(n) = nf typ + c^n 6 for positive n and n$(n) = nf typ for negative n [24| and this has led to the 5/6 
scaling prediction for cat [161 ] . Correspondingly the small deviation distribution is not expected to be a Gaussian, 
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as confirmed by the numerics [2j. In this case however the constant c$ is not related to the sixth moment of the 
small deviation distribution but rather to its right tail [l4j]. Note that the fact that the function 4>(n) is constant for 
negative n leads to L(f) = — oo for / > f typ , indeed in this region the probability vanishes as exp[— 0(N 2 )] 15]. This 
interpretation scheme allows us to make contact between our results and those of 0] ■ Indeed we find that in random 
graphs with fixed connectivity the presence of an n 2 term in the expansion of n<&(n) depends on the nature of the 
coupling distribution. For a generic distribution (e.g. Gaussian) of the coupling the term is present and the small 
deviations are expected to be Gaussian. Nevertheless if the couplings have a bimodal distribution = ± J the n 2 
term is absent and $(n) has the same qualitative properties of the SK model, namely n$(n) = nftyp + c^n 6 (with a 
different cq) for positive n and n$(n) = nf typ for negative n. Thus in the bimodal case we expect that o~n oc 7V~ 5 / 6 
and that the small deviation distribution is not a Gaussian, possibly the same of the SK model [l5[ . With respect to 
the data of [2[ we think that the expected 5/6 scaling is seen only at high enough system size as in the case of the 
SK model fig. 

Our results on <fr(n) are thus in agreement with the findings of Q. Interestingly enough the authors of Q suggested 
that the peculiar behavior of free energy fluctuations for bimodal distribution of the couplings is caused by the fact 
that the Hamiltonian is locally homogeneous. Indeed around a given site the negative couplings can be transformed 
in positive coupling through a Gauge transformation. The process must stop when the one of the sites already 
encountered in the process is reached again due to a loop of the graph, however since loops are typically large the 
disordered nature of the model appears "at infinity" . As we will see in the following our results put this intuition on 
a firm ground. Indeed we will show that are precisely the spatial inhomogeneities of the interactions that generate a 
n 2 term in n$(n). On the contrary in the bimodal case, the local homogeneity allows to obtain a solution that does 
not fluctuate over the sites (in a sense to be specified below) and this guarantees that $(n) — nf eq for positive and 
negative n both in the Replica-Symmetric (RS) case and for n < in the Replica-Symmetry-Breaking (RSB) case 
much as in the SK model. 

The plan of the paper is the following. In section [II] we will write down the variational expression of $(n) for the 
spin-glass on a random lattice with fixed connectivity (the Bethe lattice) . In sections IIIII and IIVI we will consider 
respectively the RS and RSB solution. In both cases we will show that local inhomogeneities lead to the presence of a 
0(n 2 ) term whose coefficient can be expressed in terms of the spatial fluctuations of the local fields. On the contrary 
when the interactions have a bimodal distribution the resulting local homogeneity allows to obtain a solution that 
does not fluctuate over the sites and leads to the vanishing of the n 2 term. This also implies that <3>(n) = nf eq for 
positive and negative n in the RS case and for n < in the full-RSB case much as in the SK model. In the latter 
case in order to compute the first non-trivial term for positive n we resort to an expansion of <!>(n) in powers of the 
order parameter. This is presented in section [Vj We will confirm that in the bimodal case the 0(n 2 ) term vanish and 
that the first non-trivial term in the expansion of $(n) is 0(n 5 ) much as in the SK model. At the end we will give 
our conclusions and discuss some interesting consequences of our results. 



II. THE FUNCTIONAL $(n) OF THE BETHE LATTICE SPIN-GLASS 

In this section we discuss the potential $(n) of the spin-glass defined on the Bethe lattice with fixed connectivity 
M + 1. Following [25j we express $(n) as a variational functional of the order parameter p(a) that is a function 
defined on n Ising spins a. The variational expression of the free energy reads: 

n/3$(n) = MlnTr w p M+1 (a) - ^^ln J Tr {(7} Tr {T} p M (a)p M (r)(exp J £ a a r a ) (9) 

a 

Where the square brackets mean average with respect to the distribution of J. The above expression has to be 
extremized with respect to p(o~). We note that it is invariant under a rescaling of p(a) so that we can choose any 
normalization for it. If we normalize p(o~) to the corresponding variational equation in terms of p(a) reads: 



(Tr T p M (r) expJor) 
(Tr r , CT p M (r)exp/3JaT) 



where ctt = ct q t q . 

In the next two sections we discuss the RS and RSB ansatz of p(a) that are characterized respectively by fields and 
distributions of fields. In the RS case we will find that a crucial condition in order not to have 0(N~ 1 / 2 ) Gaussian 
fluctuations is that the fields do not fluctuate over the sites (which is possible in the low temperature phase only if 
the interactions are locally homogeneous) . In the RSB case this condition becomes a condition of homogeneity of the 
populations of fields, meaning that the populations do not fluctuate. Note that at one-step RSB level this corresponds 
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to the fact that we have to consider the so-called factorized solution and the fact that fluctuating solutions are actually 
obtained at this level confirms that the true solution is full-RSB. 

In the RS case the homogeneity condition guarantees that the same solution valid at n = can be used at n different 
from zero yielding <5>(r7,) = nf eq exactly. Much as in the SK model we expect that this statement holds in the RSB 
case only for negative n, because the full-RSB solution at positive n cannot be the same at n = if we require that 
Xmin > n where x m in is the first breaking point of the q(x). Indeed the expansion in the order parameter of section fVl 
shows that the model is mapped in the SK model with different coefficients and an explicit computation shows <I>(n) 
for positive n has on 0(n 5 ) behaviour as SK. 

III. THE REPLICA-SYMMETRIC SOLUTION 

In this section we study the replica symmetric ansatz on p{a). We normalize p(<r) to one, following [26| . In the RS 
case p(u) is function of ^ a a a and is parameterized by a function R(u) as: 

p(a) = Jd U R( U ) (2cogh/3 ; )ra (11) 
where R(u) must satisfy J duR(u) — 1 because of the normalization of p(a). Accordingly we have: 

,M+1 „, \ n M+l 
j_i 

nr +i 2 cosh ^ j , 



b^^M-ln / ( P^ Y'liV.^. (12) 



We are interested in evaluating what is the dependence on n of the previous quantity for fixed R(u). Expanding in 
powers of n we get: 



lnTr wP M+ V) = „[«A))] + y [(((A*))-((A)f)]+0(n 3 ) (13) 



where we have used: 



J t=i \ Hi 2cosh/3w 4 J 

thus we see that i.f.f. R(u) = S(u — uq) (i.e. R(u) is concentrated on some value uo) there is no 0(n 2 ) term. On the 
other hand it is easily seen that in this case there are no higher terms as well, and the following relationship is valid 
at all orders in n: 

In Tr M p M+1 (a) = n(ln 2 cosh (3(M + l)u - (M + 1) In 2 cosh j3u ) (15) 

So the crucial condition in order not to have a 0(n 2 ) term is that R(u) is a delta function, and a sufficient condition 
for this is that the interactions are locally homogeneous. The other term entering the free energy can be expressed 
as: 



InTr {CT} Tr {r}P M (a)p M (r)(exp(f3 ^ a a r a )) 



exp[^2^i u i a + fi}^ i v 1 t + pjar] 



In f f[ R( Ul )d Ul f[ R{ Vl )dv t / ]T 6XP[/3 ^ 

J i=l t=l \ \tr,T 11 



i 4 cosh j3ui cosh 0Vi 



(16) 



where the square brackets mean average with respect to the distribution of J. As above we can expand in powers of 
n and obtain: 

lnTr w Tr {T}P A/ (^ M W(exp(/3E^)) = n[((B))} + ^ [(((B 2 )) - ((B)) 2 )} + 0(n s ) (17) 
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where we have used: 

«*'» = / UiRiu^Riv^] ( ( ln£ ^^TVP r Z^ J<TT] ) P ) (18) 
J f = i \V 7^ II- 4cosh/3 M4 cosh^ / / 

thus we see that the 0(n 2 ) is absent if R(ui) = S(ui) and p(J) — ± J, according to the criterion of local homogeneity 
of the interactions. On the other hand the 0{n 2 ) term is present also if R(ui) = S(ui) but p(J) is not bimodal, e.g. 
in the high temperature phase of the corresponding model. 



A. Fluctuations of the Free Energy in the Replica-Symmetric Solution 

The presence of a 0(n 2 ) term in the large deviation function leads naturally to assume that the small deviations 
of the free energy are Gaussian. A straightforward computation shows that the variance of the small-deviation is 
proportional to the coefficient C2 of the 0(n 2 ) in n$(n) according to: 

(AF 2 ) - (AF) 2 = (19) 

P 

Around n = the coefficient C2 can be computed noticing that since the $(n) is stationary with respect to R(u) the 
derivative with respect to n of $(n) is given by its partial derivative with respect to n. 
Using the definition of $(n), eq. and the expansions eq. (JT3J) and eq. (fT7|) we get: 



/3n$(n) = n 



M((A)) 



M + 1 



((B)) 



n 

T 



M({(A 2 ))-((A)f 



M + l 



{((B 2 )) - ((B)f 



+ 0{n 3 ) (20) 



where we have used definitions (fT4f and (fT8|) . The previous expression has to be evaluated using the variational R(u) 
obtained at n = 0. 

The RS solution with R(u) = 6(u) is correct above the critical temperature specified by the condition (tanh 2 (3 C J) — 
1/M. Therefore we conclude that above the critical temperature $(n) in general has a term 0(n 2 ) different from zero 
and its coefficient C2 is given by: 



c 2 = - — + 1 (((In cosh/3 J) 2 ) - (lncosh/3J)< 



(21) 



Clearly this coefficient vanishes in the case of a bimodal distribution. Above the critical temperature the solution is 
R(u) — 5(u) also for n ^ and $(n) reads: 



In 2 M + l 



ln(cosh™ (3 J) 



(22) 



again we see that in the case of a bimodal distribution $(n) does not depend on n. In the low temperature phase we 
know that the p(o~) is no longer a constant. The correct parameterization in the low-temperature spin-glass phase is 
full-RSB. In the following section we will describe the RSB ansatz and show that in general the expansion of n«f>(n) 
has a 0(n 2 ) term. Nevertheless we will see that in the case of a bimodal distribution the 0{n 2 ) term vanishes and 
that <&(n) is constant for n < much as in the SK model. In section (|V} we will compute the first non-trivial term 
in $(n) for n > and show that it is 0(n 5 ) much as in the SK model. 



IV. THE REPLICA-SYMMETRY-BREAKING SOLUTION 



The replica-symmetry breaking (RSB) parametrization of p(o~) in terms of distributions of fields was presented in 
(2(| and we refer to that paper for an explanation of the main ideas underlying it. In particular we will work in the 
Replica framework rather than using the cavity method. The resulting equations are the same but while the former 
allow a quicker derivation the latter unveils the physical meaning of the populations and the appearance of free energy 
shifts. 

We introduce the field u that parameterizes a distribution over the values of an Ising spin a according to the formula 
P(a) — exp([3ua) / '2 cosh (3u. We define a probability distribution (population) P^°\u) of such fields a 0-distribution, 



6 



correspondingly a 1-distribution is a probability distribution on probability distributions (population of populations) 
and so on. In the following a fc-distribution will be written as P^ k \ and it defines a measure 

p(k) d p{k-i) 

over the 

space of k — 1-distributions. 

In order to parameterize the function p(a) with K steps of RSB we need: 

• a JT-distribution p( K ~); 

• K integers 1 < x\, . . . , xk < n (as usual for n < 1 they become real and the inequalities change sign); 

In the following we will consider the parameters 1 < x\, . . . , xk < n fixed and consider just the dependency on the 
distributions. The construction is iterative and requires a set of functions ppw (a) of Xk+i spins with k = 1, . . . , K + 1 
(we define Xk+i = n and xq = 1). The normalization of p P (k) is crucial, we choose to normalize all of them to 1. We 
define p P (k)(a) starting from p P (k-i)(a), we first divide the Xk+i spins in Xk+i/xk groups {<Jc\ of Xk spins labelled 
by an index C = 1, . . . , Xk+i/xk- Then we have: 



ppW (a) 



p(k) dP (k-i) Y[ p pl u-v({a} c ) 
c=i 



(23) 



Thus p{ci) — p P (K) (a) is defined iteratively starting from the Replica- Symmetric case corresponding to k = 0: 



PpwW) = J P (a) (u)duf[ 



exp (3uui 
2cosh/3u 



(24) 



With the above definitions it is possible to express the variational free energy (0) in terms of the populations of 
populations in the same way as we derived eq. (|12p and eq. (|16p . In order to do that we need to introduce two 
functions: AF^ [pj^ , . . . , P^ + i\ is a function of M + 1 fc-populations and [Pp' , . . . , P^m jJ] is a function of 

2M fc-populations and a coupling constant J. Their definition is iterative, i.e. the function at level k is defined in 
term of the function at level k — 1: 



AF ( k )( P w P 



(fc) P (fc) > 

M+l J 



1 



Pxk-i 



■In 



M+l 

n 



p {k) dp {k ~ i] 



-/fakflAfj (P x ,...,P M ) 



(25) 



p{k) t\ 
• r 2M' J > 



1 



In 



2.1/ 



(fc) > p (fc-l) 



i = l 



The above definitions have to be supplemented with the definitions for k — that read 

"M+l 



AF (o) (p (o) j 



p(0) N 

^M+l^ 



1 

Jx-_ 



■In 



n ^ 



i=l 



.J) 



2cosh/3^j = i \ 

n-it l2c ° sh ^ / 



(26) 



(27) 



AF (»)/p(0) P (o) n _ 1 ]n 
A -^12 (+1 ) • • • ) %i J ) = 111 



271/ 



(3 Jar] 



IIi=i 2 cosh @m 



(28) 



A. The Functional $(71) in the Replica-Symmetry-Breaking solution 

The variational free energy expressed in term of the if-population PW that parameterizes p(a) reads: 



M + l 



ln(e 



-f3nAFg ) (p( K \...,P l - K \j)x 



(29) 



where the square brackets mean average over the coupling constant J and we have used the functions defined above. 
The proof that the above expression is equivalent to §§§ is not very complicated and we will not report it. We just 
mention that it can be obtained in an iterative way much as we will do in the appendix for the variational equation. 
In order to determine the K- population that extremizes (|29p we need to solve the corresponding variational equations 
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obtained differentiating it with respect to p( K \ An equivalent way to obtain PW is to consider the variational 
equation (|f 0[) and rewrite it in terms of p( K > , we will show how to do this in the appendix. For practical purposes 
this second method is to be preferred because the corresponding equations can be solved by means of a population 
dynamics algorithm (26j . however in order to study the small-n behaviour of <&(n) is more useful to consider that 
variational expression (|29|) . 

In general the K- population that extremizcs (|29|) depends on the value of n. In order to determine the expression 
of <f>(n) at small values of n we can expand expression (|29|) at the second order in n around n = 0. This expression 
is variational in p( K > and therefore the total second derivative of n<f)(n) with respect to n is equal to the partial 



second derivative. However we must keep in mind that AF[ K ^ and AF^' both have an implicit dependence from n, 
therefore in order to derive with respect to n we make this dependence explicit by rewriting expression (|29l) as: 



ra/3$(ra) = -Mln 
M + l 



M+l 



•In 



2M 



(K) jp(Jf-l) 



M + l ' -[- 



(-K-1),-d(-K-1) p(-K-l) 

'■■■' r 2M '"'/! 



(30) 



Expanding in powers of n we get: 
/3n$(n) = n 



M«Ax)) - ^±I«A 12 » 



2 r 



M(«A?» - ((Ai)) 2 ) - ^±i«(A 2 2 )) - «A 12 )) 2 ) 



+ 0(n 3 ) 



where we have defined: 



M+l 



»=i 

2M 



AF 



AF 



(jc-i)^ppr-i) 

:/v-l)^p(i<r-l) 



12 



p(^-l)^ 
'^M+l / 



i r 1M ' J ) 



Thus we conclude that the coefficient c 2 of the 0(n 2 ) term in the small- n power series of is given by the 

coefficient of the above 0(n 2 ) term evaluated with the population pW corresponding to n — 0. Therefore in general 
C2 will be non-zero and we will expect Gaussian fluctuations with variance given by eq. (|19p . 

We note that the physical interpretation of the X-RSB ansatz is that on a given sample (i.e. a graph with a given 
disorder realization) the local fields on a given sites are described by a K — 1-population and the population P^ K ) 

represents the distribution over the sites of these K — I-populations [26[. The functions Af[ K l ' and AP^ ^ are 
interpreted as the free-energy variations (shifts) that are observed in the process of adding respectively a spin and a 
bond to a given graph [2(| . Thus the interpretation of the above equation is that the Gaussian fluctuations of the free 
energy are determined by the local fluctuations of the free energy shifts. 



B. The factorized solution 



The results of the preceding subsection tell us that the 0(n 2 ) term will be absent only if there are no spatial 
fluctuations in the distribution of the fields. This corresponds to the fact that P^ K > is given by the so-called factorized 
solution P(*0 = 5{P {K -^ - P (K ~ 1} ). Indeed it is easy to check that if P {K ^ is factorized the term (((A 2 )) - ((Aj)) 2 ) 
vanishes. In order to have that also the term (((Af 2 )) — ((^4i2)) 2 ) vanishes we need also the condition J = ± J (in the 
high-temperature phase the 0(n 2 ) term is determined solely by the fluctuations of J). 

The variational equation for p( K ) reported in the appendix shows that pW can be factorized only if the couplings 
have a bimodal distribution J = ± J. We argue that in this case the correct distribution is indeed factorized. Note 
that for K = 1 a non-factorized solution was found in [2|| for the bimodal case. We believe that this is an artifact of 
the fact that the correct solution has an infinite number of RSB steps ^ = 00. This is similar to what happens for 
the function q(x) of the SK model: in the 1RSB ansatz we find g(0) 7^ while q(0) = in the full-RSB solution [18| . 

In the bimodal case one can see that the factorized solution pW = ^(P^ -1 ) — P^ K 1 - ) ) is such that Pq K ^ is 
independent of n. As a consequence $(n) is constant in n. Much as in the SK model we argue that <&(n) is constant 
only for n < 0, while for n > we have to abandon the factorized solution corresponding to n — because of the 
condition that the smallest RSB parameter x m i n must be larger than n. In order to study this effect and to determine 
the first non-trivial term of <!>(n) for positive n in the following section we will study an expansion of $(n) in the 
order parameter. 
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V. EXPANSION OF <E>(n) IN POWERS OF THE ORDER PARAMETER 

In this section we report the expansion of the potential $(n) of the spin-glass defined on the Bethe lattice with fixed 
connectivity M + 1 in powers of the order parameter. Note that following [25j we will use a different normalization 
of p{p) with respect to the previous subsection, we write it as: 

n 

Q_o> i . . . a k ®ol i • ■ ■ ® OL k (31) 

fc=0 (ai...afc) 

with 



bk = (cosh n j3J tanh /3J) and b k = b k /b (32) 



The variational equation reads: 



Tr {T}P M (T){ex-p/3JJ2 a °aT a ) 
Tv {T} p M (r) 



expressed in terms of the q ai ...a k reads: 



Tr M cr Ql . . .a ak p M (a) 
Tr {ff} p M (a) 



9ai...o» = —„ -Kfrr, (34) 



We have expanded expression Q in powers of the order parameter q a t, at fourth order. The four-indexes order- 
parameter q a bcd has been expressed in terms of q a b by means of its variational equation. In the appendix we give some 
details while here we report the results: 

= - — ^ 1 In b - n In 2 + F var . (35) 

Where 



F var E, -I T rg 2 - - V -Tr q* + \ £ q\ b q\ c - + |(Trg 2 ) 2 + 0(g») (36) 

26 



where the various coefficients depends on 6^ with k = 2,4, see their explicit expressions below. 

In the high temperature region we have q — and therefore F var — 0, thus the only relevant term is the first 
term in eq. [351 If J can take just two values J = ± J we have 60 = cosh™ (3 J, therefore for T > T c $(n) is just a 
constant in n. From a high temperature expansion we can verify that in this case the fluctuations of the extensive 
free energy scale as AF = O(l). On the contrary if the distribution of J is not just peaked at ± J, $(n) is linear in n 
and the fluctuations of the extensive free energy are Gaussian with A_F = 0(y/~N). Therefore if the graph is locally 
homogeneous the first term immediately yields small 0(1) fluctuations above the critical temperature. 

Below the critical temperature we have to check whether n$(n) is quadratic in n around n = 0. We note that the 
various coefficients {r,uj,u,v,y} in eq. (|36p depend on n and on the temperature, however we first study the model 
with fixed coefficients and variable number of replicas n; we also reabsorb the coefficient y in y, which is possible 
if we restrict the choice of the matrix q a b to those that verify the condition that (q 2 ) a a does not depend on a, this 
produce an additional dependence of y from n because y + ny — > y but, like the other coefficients, we first consider 
it as independent of n. 

We have computed the free energy of this model, basically generalizing Kondor's original computation to general 
values of the coefficients and including all the fourth-order terms. We have found that much as in the SK model: i) 
the first non linear term in the expansion of n 3?(n) for n > is 0(n 6 ), due to non-trivial cancellations at order 0(n 2 ) 
and 0(n 4 ) and ii) n <I>(n) is just linear in n for n < 0. More explicitly we have for n > 

2u + 9v + 6y 4 5 . 



m 6 



5120 \ u e u 7 u 8 



40-jr - 75^ + 36^- + O(t) + 0(n 7 ) for n > (37) 

I/O 11I 7/8 / v ' 
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In the SK model we have u> = u = v = y = l and we recover Kondor's value —9/5120 for the 0(n 6 ) coefficient. Now 
to study the actual rt-dependence of the model we have to take into account the fact that the coefficients {t, oj, u, v, y} 
depend on n, indeed the various coefficient reads: 



(1 + M) ~b\ (-1 + Mb 



M (-1 + M 2 ) b\ [-2 + 2,Mb 2 
M (-1 + M 2 ) b\ (z (-2 + M) + M (-1 + 4 M) b A + 2Mb 2 (b-3M + (-3 + M) M 6 4 ) ) 

-I+M&4 

M (—1 + M 2 ) b\ (& - 3 M + (8 - 11 M) M 6 4 + M 6 2 f-9 + 5 M + M (1 + 3 M) 6 4 



y = 



-1 + M 6 4 

(-1 + Af 2 ) &f (-6 (-2 + M) + 3 (3 - 5 M) M 64 + 4 M 6 2 (-2 + M + M (-1 + 2 Af) 64) ) 



M 



1 + M 6 4y 

M (1 + M) &| (-3 + 4 M + (2 - 3 M) M 2 64 + A/ 3 6 2 (m 6 4 - l) + 4 (M - 1) Af 6 2 (m 2 64 - l) ) 

4 (M 64 - l) 



(38) 



In order to recover the SK limit of the above coefficients, we have to rescale the couplings as J = J/M 1 ' 2 where 
J is a random variable with unit variance and take the limit M — > 00. We obtain r = 1 — T + 0(1 — T) 2 and 
uj = u = v = y=\, while y — Q i.e. as it should. 

Each coefficient depends on (3 and n through bk and we have: 

b k = (tanh fe /3J> +n((lncosh/3Jtanh' £ /?J) - (In cosh /?J) (tanh* /3J}) + 0(n 2 ) (39) 

Therefore the coefficients for a generic distribution of the J's have a linear dependence on n that, included in expression 
(|37p. leads to a 0(n 2 ) dependence of n$(n). Note that the coefficients have a dependence from n that is regular around 
n = and therefore the first term in eq. (|37|) is regular in n around n = 0, but there is still the 0(n 6 ) term which 
produces a non regular dependence from n around n = 0. In other words in the general diluted model the function 
n<j)(n) develops a regular 0(n 2 ) dependence but there is still a singularity at n = in the sixth derivative. Near the 
critical temperature the leading 0(n 2 ) term is given by the n dependence of r in eq. (|3T[) and therefore is 0(r 2 ), 
expanding eq. ([55)1 in powers of n we get for the 0(n 2 ) term of F var : 

n 2 ( 4(M _ ijT( M + ^ ^((lncosh^Jtanh 2 /3 C J) - (lncosh/3 c J)(tanh 2 /3 C J)) + O(r 3 )^) (40) 



Where r is given by eq. (|38|) computed at n = 0. 

We consider now the locally homogeneous case in which J = ± J with equal probability. We note first that in this 
case the coefficients bk do not depend on n anymore (see eq. I32[) and as a consequence t,uj,u and v do not depend on 
n neither. Thus the only dangerous coefficient is y in which we have reabsorbed the coefficient y through y-\-ny—* y. 
The y coefficient turns out to be zero and therefore the behavior of the model is the same of the SK model, the first 
non linear term in n(f>(n) being 0(n 6 ). To be more precise we have checked that there are no 0(n 2 ) terms in n<fi(n) at 
the first non-trivial order in r, because y defined according to eq. (|38p actually is zero only at the critical temperature 
where 6 2 = 1/M and 64 = 1/Af 2 (because J = ± J) but has small non-zero corrections 0(t) at higher orders. These 
0(n 2 ) corrections are likely cancelled by the 0(n 2 ) higher order term TrQ 2 Tr<5 3 not included in the computation. 

In the appendices we report a similar expansion for the variational equation and various quantities relevant for the 
computation. 



VI. CONCLUSION 



We have investigated the large deviations free energy functional $(n) in the case of the Bethe lattice spin-glass 
and we have confirmed that Gaussian behaviour of the free energy fluctuations has to be expected whenever there 
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is no local homogeneity of the interactions. In particular the only case in which we found a non-Gaussian SK-like 
behaviour in when the random couplings can take only two possible opposite values — ± J with equal probability. 

In general the quantity $(n) can be expressed in terms of a distribution of fields. In the RS case we have a single 
distribution corresponding to the possible values of the cavity fields at different sites of the lattice for a given disorder 
realization. In the RSB phase we have a population of populations, i.e. on each site we have a population of fields 
corresponding to the presence of many states. We have found that if the system is locally homogeneous we can find 
a locally homogenates distribution of the fields and this leads to the vanishing of the 0(n 2 ) term in $(n). Thus we 
argue that the correct RSB solution in the bimodal case is the so-called factorized solution. Instead if the system is 
not locally homogenates the 0(n 2 ) terms in $(n) can be evaluated using the n = solution because of stationarity. 

We have also verified that the expansion in power of the order parameter near the critical temperature in the locally 
homogenates case is formally equivalent to that of the SK model and found that <I>(n) has the same 0(n 5 ) behaviour 
of SK for small positive n. 

We note that the fact that in the bimodal case n$(n) = nf typ for n < has some interesting consequences. 
Indeed since $(n) is the Legendre transform of the large deviations function L(f) (see eqs. (|5|6|7|8p ) it follows that 
L(f) = —oo for free energies per spin larger than the typical one ftyp- This means that the probability of finding 
a sample with / > f typ is smaller than exp[0(iV)]. Indeed for the SK model a recent computation [la ] has shown 
that P(f) oc exp[0(7V 2 )]. This scaling cannot hold for the Bethe lattice because while the total number of samples is 
actually exp[0(iV 2 )] in the SK model, the total number of samples on the Bethe lattice is exp[(M+l)NlnN] at leading 
order. Thus we argue that in the Bethe lattice with bimodal distribution of the couplings P(/) oc exp[0(JVlnJV)] 
for / > fty P although the actual computation is beyond the scope of this work. For M — 1 detailed computations 
are easy. Nevertheless we note that free energies larger than the typical one can only be observed on graphs with 
topologies different from the typical one, (e.g. a regular lattice). In other words the probability of observing a free 
energy (and in particular a ground state energy) larger than the typical one on a graph with typical topology is strictly 
zero. Indeed suppose that by just changing the signs of the interactions of a typical graph (i.e. without modifying the 
incidence matrix) we could raise the free energy per spin. Since the number of links on a graph is precisely N 
the probability of such a sample will be exp[0(N)] and this would lead to a non-constant <&(n) for n < contrarily 
to what we have computed. 



APPENDIX A: THE VARIATIONAL EQUATIONS IN TERMS OF POPULATIONS 



In this appendix we write the variational equations in terms of populations. These equations have been obtained at 
the level of one-step RSB in [261 ] using the cavity method. In the following we write them down for a generic number 
of RSB steps using the replica method. The variational equation that extremizes the free energy (J9j> reads: 



Pip) 



(Tr tP M (t) expJar) 



(Tr T . aP M (T)exppJ<jT)- 
in terms of the if-population the above equation reads: 

" M 



(Al) 



1 



/ e -0nAF(K)(p(.K) p(K),j)| 



p(^-'-)\ e -0nAF 



i=l 



(A2) 



Where the square brackets mean average over the disorder. In the above equation we have used the following 
functions of populations: i) a function P' fe ) [ pW , . . . , pffl , J] that yields a fc-population from M other fc-populations 
and ii) a function APW [p[ k) , . . . , P$, J] (also called the free -energy shift 26]) that yields a real number from M 
k- populations. The definition is iterative: the function P^ and AF^ at level k of RSB are defined starting from 
the functions P^" 1 ) and AF^'" 1 ); 



(fe) 



p(fe) 7\ 

M ' J ) 



-l3x k+1 AFW(P^ k \ 



x e 



-f3x k+1 AF 



(k-l)/ p(k-l) 



(Pi" 



M 



(fc) , p (fe-l) 



U P idP, 



i=l 
J) 



S(P 



(k-1) 



p(fc-l)) 



and 



AFW(pW,...,pW,J) 



In 



+i 



M 



(k-1) 



,(fc-i) 



J) 



(A3) 



(A4) 
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The iterative definition has to be supplemented with the k = case that reads: 

M 



P(°)(P 1 (0) ,...,P^,J) 



(0) 



1 



e -/3 3 ; 1 AF(0)(P 1 (t ",...,P^ ) ,J) 

x S 



4 cosh (3 J cosh (3 J2i 
nfii 2cosh/3Mi 



u — u 



and 



AF<°)(pf>,...,pj?,J) = -^ln/ 



A/ 



4 cosh /3 J cosh /3 J2i 
UiLi 2cosh/3ui 



where we used the definition 12611: 



J) = — arctanh[tanh/3Jtanh/3/i] 
We recall also the relationship between the populations and p(cr): 



J c=i 



(A5) 



(A6) 



(A7) 



(A8) 



In the following we will prove the equivalence between eq. (|A1[) and eq. (|A2[) . We basic step is to prove that the 
following fundamental equation holds at any level k: 



Tr TC ^IJ/0p_(*)(7"c)J exp/3Jcr C T C 



Pp(k>{(Tc) 



(A9) 



In the above equations uq and tq are two sets of Xk+i spins and rccc = ^2a^i a a T a- The proof is iterative: assuming 
that the equation is satisfied at level k — 1 we will show that it is also satisfied at level k. In order to do that we 
divide the Xk+i spins uq in Xk+i/xk groups <jc of Xk spins and we use the definition (|A8[) : 

x k+1 /x k 



/ M \ / M . x k+1 /-i 

Tr rc Hp p m(tc) expPJacrc = Tr TC J[ / pf^Pf" 13 J] 
Vi=l * / ^1=1^ C'=l 



P P (fc-i)(Tc) expPJa C T C 



M 



Xk+l/xk 

n t ^ 

C'=l 



,1/ 



\i=l 



(A10) 



![/',%//>/' 1 

.i=l 

Now assuming that eq. (|A9|) holds true at level k — 1 and integrating over a delta function ^(pC 0-1 ) — p( fc_1 )) we get: 

(All) 



/M \ 

Tr TC JJppw(rc) exp/3Jcr c r c 



M 



(fc) jp(fc-l) 



(fe-l)Cp(ls-i) p(fc-i) 

' " ' ' A: 



.J) 



Xk+l/Xk 

II -°p(^d( ct cO (A12) 

C' = l 



we see that the term in curly brackets corresponds to the one in the definition (|A3[) , and using the definition (|A8p we 
conclude that eq. (|A9|) holds true at level fc. 

In order to complete the proof we need to show that eq. (|A9|) holds for k = 0. In this case uc is a group of 
spins, using eq. (|A10[) we have: 



Tr Tc PpM ( T c)^j ex P P J a cTc = J 



M 



f M 

n 



exp /fajTfl 

2 cosh j3ui 



expf3Ja a r a 



now summing over each r a and introducing a delta function 5 (it — u(y~)f?_-, Uj, J)) and using the definitions (|A5|) and 
(|A6|) we can see that eq. (IA9|) holds true also at level k = 0. The equation (|A9[) can now be used to prove the 
equivalence between (jAll) and (|A2|) . 
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APPENDIX B: THE ORDER-PARAMETER EQUATION 



In this appendix we report an order parameter expansion of the variational equation (|34[) . Expanding equation (|34l 
for q a b c d m powers of the order parameters we get (see appendices [C] and [Dj : 



Qabcd 



M(M-1)~ 2 . , 3 . 

-0 2 (<labqcd + QacQdb + qadlcb) + 0(q ) 



1 - Mb 4 

Substituting this expression in eq. (134|) for g a ;, we get at the third order in the order parameter q a i>: 

= Ci q ah + C 2 (<7 2 ) a fc + C 3> 1 (<J 3 )afc + C 3i2 <?at>((<? 2 )&b + (q 2 )aa) + C 3 ,3 <?ab + C 3 ,4 <?afcTr Q 2 



(Bl) 



(B2) 



Cl 
C2 

c 3,l = 

C3,2 = 

C3,3 = 

C3,4 = 



M6 2 - 1 
b\{M 2 - M) 

~ 3 (M - 1)M(M6 4 +M-2) 
2 Mfo 4 - 1 

~ 3 (M - 1)M(M% + M-2) 



Mb a - 1 

2b\ (M - 1)M(M(2M - 1)6 4 + M - 2) 
3 M~b A - 1 

61 (M - l)M(M 2 b 4 - 1) 
2 Mh - 1 



The coefficients of the previous expansion are different from what could be obtained by differentiating the variational 
expression eq. ([35]) derived above. This can be understood noticing that the equation for the order parameter 
corresponds to the following expression: 



= Tr 



CaOb p(a) - 



Tr T p M (r)(expJE e ^T- c ) 
Trp M (r) 



while the equation one obtains by differentiating eq. ^ corresponds to: 

Tr T( o M (Y)(exp J J2 C a c T c 



= Tr 



p M - L (W})a a a b [p(a) 



Trp M (r) 



(B3) 



(B4) 



Thus the two expressions are equivalent in the sense that they have the same solution at the order at which they are 
valid. It can be checked explicitly that the coefficient 03,4 (as much as a 4 , 4 ) vanishes at zero-th order in the expansion 
in r, noticing that at T = T c we have b\ — 1/M and 64 = l/M 2 (because J = ±J). 

In the Sherrington-Kirkpatrick limit M — > 00 and J — (J)/\/M with J 2 = 1 the coefficients of the order parameter 
equation go to the corresponding SK limit as can be also seen noticing that in this limit eq. (|B3|I reduces to the 
corresponding SK equation: 



q a b 



Tra a a b exp[/3 2 £ a<6 Q ab&a&b\ 
Tr exp[/3 2 Y^ a <b QabO a Ob\ 



(B5) 



APPENDIX C: TRACES OF p(a) 



In this section we report various quantities that are relevant to compute the expansions in the order parameter. 
We define: 



p(a)=b (l + g(a)) 



(Cl) 



7W = feE 



(C2) 



a<b 



a<b<c<d 
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Then the following traces are needed to compute the expansion of the variational expression of $(n). In order to 
compute them we need also the traces over spin reported in the next appendix. 

iTr.9 = (C3) 



2™ 
1 

2™ 



^Tr.9 2 = §^^ + ~ b l( M 1 {M M ^ ~ b l) (^(Tr < Z 2 ) 2 + jTr, 4 -^^L + iE^)+ ^) ( C4 ) 



abc ab 

.5 



b + 0(q°) (C5) 



±Tr? = llTr q * + ?,Ul( M{M -S b 2 ) ( \(Tr q 2 ) 2 + Tr , 4 - 4 £ q 2 ab q 2 ac + 2 £ q ab 
^Tr.g 4 = 6 4 ^(Tr g 2 ) 2 + 3Tr g 4 -6E^ c + 4E^ + 0(<z 5 ) (C6) 

In order to sum over q a bcd in Tr g 2 we used the following identity valid for a general A abc d symmetric with respect to 
permutations of its indexes 



(C7) 



y ' A a bcd — I ^ ' A-abcd 6 ^ ' A aa b c + 3 ^ ' A aa bb + 8 ^ ' A aaa b — 6 ^ ' A aaaa J 

a<b<c<d \abcd abc ab ab a / 

The following traces are needed to compute the expansion of the equation for the order parameter: 

-^Tra a a b g = b 2 q a b (C8) 
^TxOaObQ 2 = 2b 2 {q 2 ) ab + 

+ 26 2 6 4 ( ^'^ tt) ((« 3 )»6 - ^((^U + (A) + 2<& + \^ ^ + 0(<? 4 ) (C9) 

^Tr ^^.g 3 = ^ ^ 6(? 3 )afc _ 6(?ofe ( ((? 2 )aa + + 4^ + 3^ ^ + 0(<?4) (C10) 

b^/Trp M = 1 - Jm(M - l^Trg 2 + 0(<z 3 ) (Cll) 
The next traces are needed to compute the equation for q a bcd- 

^■Tr a a a b (Tc<Jdg = foqabed (C12) 
^-Tr a a a b a c <T d g 2 = 2b 2 2 {q ab q c d + q ac qbd + q a dq c b) + 0(q 3 ) (C13) 

APPENDIX D: SPIN TRACES 

In the following we report the values of traces over the spins. They have been computed using the following general 
formula 

— Tr<7 a (TbVc<Jd ■ ■ ■ OeOfOgOh = ^ S a b5 c d ■ ■ ■ S e fS gh - 2 ^ dgbed ■ ■ ■ SefSgh + 

7T 7T 

+ 16 ]T Sabcdef ...S gh +A^2 SabcdSefgh • • • H (Dl) 

7T 7T 

The above expression represents the fact that each of the spins a a , ct , ■ ■ ■ must appear an even number of times in 
order for the trace to be non zero. The first term describes the case in which each spin appears just two times in 
the sum and the index tt runs over all different permutations of the indexes that change S a bS c d ■ ■ ■ S e fS g h- The second 
term describes the case in which one spin appears four times and all the other appear two times. However if this is 
the case the first term also give a non-zero contribution, for this reason the second term has the factor —2 in front of 
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it, because that the l.h.s. of (|D1[) is either or 1. Again the index ir runs over all permutations of the indexex that 
change the summand. The third term corresponds to the case in which one spin appears six times in the sum, while 
the fourth corresponds to the case in which two diffent spins appears four times each in the sum. To give an example, 
in the case of four spins expression (|D1|) specializes to 



— Tr G a a h a c G d = S ab S cd + S ac S bd + S ad 6 cb - 25 abcd (D2) 



Using these expression to couple the replica indexes we get: 



^Tr (^2q ab a a a^j = (D3) 

^Tr (^2q ab a a a,}j = 8Trg 3 (D5) 

^Tr (j^qaba^ = 48Trg 4 - QG^llbllc + 64$>2 6 + ^(Trq 2 ) 2 (D6) 

\ ab / abc ab 



2 

Other traces necessary to the expansions are 



^Tr ($> 2 W <7 « <7 >) (j^qabCTaCT,] = 4Trg 4 -8^^2 c + 2(Trg2) 2 (D?) 

\ ab / \ ab / abc 

^■Tr I ^ qmn<J m <?n j Oa<Jb = 2q ab (D8) 
\ ran / 

^Tr l^ 9m „a m a„) a a a b = 48(q 3 ) ab - 48q ab ((q 2 ) aa + (q 2 ) bb ) + 32q 3 ab + 12 9afc Tr q 2 (D9) 

\ mn / 

^-Tr | ^((7 2 ) mn cr m cr„ J ( ^ qmn&mVn J VgVb = 8(q 3 ) ab + 2q ab Tr q 2 - Aq ab {{q 2 ) aa + (q 2 ) bb ) (D10) 

\ mn / \ mn / 
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